Xeon E5-2690 v2

A 26-billion-parameter Gemma 4 mixture-of-experts model can run at reading speed on decade-old Xeon CPUs, achieving ~5.2 tokens per second on a dual-socket 2013 Ivy Bridge system with no GPU, thanks t…

A developer running Google's Gemma 4 26B mixture-of-experts model on a 13-year-old HP StoreVirtual server with dual Ivy Bridge Xeons and no GPU achieved 5 tokens per second by patching inference kerne…